Collins Russian Dictionary 2nd Edition © HarperCollins Publishers 2000, 1997:
horseback [ˈhɔːsbæk] adj верхово́й
adv
on horseback верхо́м
police on horseback ко́нная поли́ция
* is used to mark translations which have irregular inflections. The Russian-English side of the dictionary gives inflectional information.